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Abstract — Spatially-coupled low-density lattice codes (LDLC) 
are constructed using protographs. Using Monte Carlo density 
evolution using single-Gaussian messages, we observe that the 
threshold of the spatially-coupled LDLC is within 0.22 dB of 
capacity of the unconstrained power channel. This is in contrast 
with a 0.5 dB noise threshold for the conventional LDLC lattice 
construction. 

I. Introduction 

Kudekar et al. rigorously proved that the belief -propagation 
(BP) threshold, the maximum channel parameter (worst chan- 
nel condition) that allows transmission with an arbitrary small 
error probability, for low-density parity-check (LDPC) codes 
improves up to the maximum-a-posteriori (MAP) threshold 
by spatial coupling. This phenomenon is called threshold sat- 
uration (T). The threshold saturation phenomenon is observed 
not only for the binary erasure channel (BEC), but also for 
general binary memoryless symmetric channels [2]. Moreover 
empirical evidence via density evolution analysis has been 
done for other channels, such as the multiple access channel 
O, a relay channel |4), and a channel with memory 0. 

The performance improvement via spatial coupling has 
not only been reported for LDPC codes, but also many 
other problems. For example, compressed sensing (6), BP- 
based multiuser detection for randomly-spread code-division 
multiple-access (CDMA) Q, and K-SAT problem @ have all 
shown a benefit by using spatial coupling. We conjecture that 
the threshold saturation phenomenon is universal for graphical 
models, in particular for sparse systems. 

Low-density lattice codes (LDLC) are lattices defined by 
a sparse inverse generator matrix. Sommer, Feder and Shalvi 
proposed this lattice construction, described its BP decoder, 
and gave extensive convergence analysis J9). Since decoding 
complexity is linear in the dimension, it is possible to decode 
LDLC lattices with dimension of 10 6 . Although LDLC lattices 
can be decoded efficiently, capacity-achieving LDLC lattices 
have not so far been constructed. The best-known result is 
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that a noise threshold of LDLC appeared within 0.6 dB of the 
capacity of the unconstrained-power AWGN channel J9j- 

In this paper, we consider spatially-coupled LDLC, which 
will be abbreviated SC-LDLC. By using Monte Carlo density 
evolution with a single-Gaussian approximation, it is observed 
that the threshold of SC-LDLC approaches the theoretical limit 
within 0.22 dB. 

II. Low Density Lattice Codes and Their 
Protographs 

A. Lattices 

An n-dimensional lattice A is defined by an n-by-n genera- 
tor matrix G. The lattice consists of the discrete set of points 



(xi,x 2 , 



for which 
x = Gb, 



where b = (&i, . . . , b n ) T is from the set of all possible integer 
vectors, bi E 7L. The transpose of a vector x is denoted x T . 
Lattices are linear, in the sense that xi + X2 G A if xi and 
X2 are lattice points. It is assumed that G is n-by-n and full 
rank (note some definitions of SC-LDLC allow G to have 
additional rows which are linearly dependent). 

We consider the unconstrained power system, as was used 
by Sommer et al. J9). Let the codeword x be an arbitrary 
point of the lattice A. This codeword is transmitted over 
an AWGN channel, where noise z,i with noise variance a 2 
is added to each code symbol. Then the received sequence 
y = (yi, V2, ■ • • , Un) is Ui = Xi + Zi, for i = 1, 2, . . . , n. 
A maximum-likelihood decoder selects x as the estimated 
codeword, and a decoder error is declared if x ^ x. The 
capacity of this channel is the maximum noise power at which 
a maximum-likelihood decoder can recover the transmitted 
lattice point with error probability as low as desired. In the 
limit that n becomes asymptotically large, there exist lattices 
which satisfy this condition if and only if iflOl : 

- |det(G)| 2 /™ 



a" < 



2?re 



(1) 



In the above |det(G)| is the volume of the Voronoi region, 
which is the measure of lattice density. 



III. Spatially Coupled Protograph of LDLC 



Fig. 1. Protograph of (a, d = 5) LDLC. The circle and rectangle nodes 
represent variable and check nodes, respectively. Black line denotes a edge 
labeled 1 and gray lines denote edges labeled w. 



B. Low Density Lattice Codes 

An LDLC is a dimension n lattice with a non-singular 
generator matrix G. An inverse generator matrix H = G~ 
of the LDLC is sparse, so that LDLC can be decoded using 
BP J9). The n-by-n matrix H of an {a, d) LDLC has row and 
column weight d, where each row and column has one non- 
zero entry of weight ±1 and d — 1 entries with weight which 
depends upon a. More precisely, the matrix H is defined as: 



h = p' 1 + w ]Tp;, 



i=2 



where 



P- = S,P, 



(2) 



(3) 



Si denotes a random sign change matrix, P^ denotes a random 
permutation matrix, and 



- 1 

We choose < a < 1, so that BP decoding of LDLC will 
converge exponentially fast (9) . The permutations result in H 
having exactly one 1 and exactly d — 1 u>'s in each column 
and row. The random sign change matrix Si is a square, 
diagonal matrix, where the diagonal entries are +1 or — 1 with 
probability 1/2. The bipartite graph of an LDLC can be defined 
similarly to LDPC codes J9). 

For the lattice construction considered in this paper, each 
row and each column of H has one 1 and d — 1 w's, and with 
w <C 1 the power is suitably normalized, since such lattices 
have |dct(G)| — > 1 as the dimension becomes large. 

C. Protograph of LDLC 

As with protograph-based LDPC codes, it is possible to 
construct a matrix H from a protograph. Fig. Q] shows a 
protograph of an (a, d) LDLC for d = 5. The circle and 
rectangle nodes represent variable and check nodes, respec- 
tively. The black edge denotes the label 1 edge and gray edges 
denote the label w edges. The degree of each node is d = 5. 
From the protograph, the usual bipartite graph of the LDLC is 
generated by a copy-and-permute operation jll|, with random 
sign changes and label assignments for respective edges. 



In this section, we first define (a, d, L) SC-LDLC, then 
(a, d, L, K) SC-LDLC will be introduced. 

A. Standard Coupling 

We define a (a, d, L) SC-LDLC as a dimension n(L — d+1) 
lattice with an n(L — d + 1) x nL inverse generator matrix 
H[L] as described by Eq. (|5). The structure of H[ L ] is similar 
to the parity check matrix of tail-biting convolutional codes. In 
Eq. (O, H"' = P x + w'^2i = 2'Pi lS an inverse generator 
matrix of a n dimension {a, d) LDLC for 1 < I < L, and 
each Pj- represents a distinct matrix of the form of ||3}, for 
distinct I and d. 

In this construction, some integers are terminated to 0. The 
integer vector of the form: 



0, 



(d-l) 



is used, so that if x G A, then H[l] • x = b. Here, b = 
(bi, . . . ,bi, . . . , fon(L-d+i)) T iS an information integer vector, 
i.e. bi G Z. And, n (d_i) is the all zero column vector of 
length n(d — 1). The dimension of the lattice is, therefore, 
less than the number of elements in x, which is nL. 

The protograph of (a, 5, 18) SC-LDLC is shown in Fig. [2] 
Reliable messages from white rectangle nodes (null check 
nodes), i.e., 15, 16, 17, and 18, are gradually propagated. In 
the protograph, a node corresponds to n variable nodes or n 
check nodes, and nodes are connected according to an entry 
in Eq. (0) corresponding to that edge. BP decoding, as well 
as density evolution, proceeds on the protograph, using Hrj,], 
as with protograph-based LDPC codes ifTTl . 

Associated with the lattice is an nL x n(L —d+1) generator 
matrix Grn. The Grn has a sub-matrix from column 1 to 
n(L — d+1) which is an nL x nL non-singular matrix Grj,]. 
Therefore a lattice point in the dimension n(L — d+1) lattice 
is generated with 



x = G [L] b = 

Dimension ratio is defined as 
n(L-d+l) 



G m b. 



(4) 



Rl 



1 



d-1 



nL L 

The ratio Rl converges to 1 with increasing L, with gap 
0(1/L). Therefore, this dimension loss is negligible for suf- 
ficiently large L. 

B. Randomized coupling 

In order to simplify the evaluation of the noise threshold, 
we define a (a, d, L, K) SC-LDLC in this section. A bipartite 
graph of a code in the (a, d, L, K) SC-LDLC is constructed as 
follows. Similar to the {a,d,L) SC-LDLC, for each position 
I G {1, . . . , L}, there are n variable nodes and n check nodes. 
Each of the d edges of a variable node at position / connects 
uniformly and independently to a check node at position / G 
{I, . . . ,1 + K — 1}, so that every check node has one edge 
labeled 1 and d— 1 edges labeled w. Note that I is taken modulo 
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Fig. 2. Protograph of (a, d = 5, L = 18) SC-LDLC. White rectangle nodes 
are null check nodes corresponding to O n f<j_x). 



L value, if I > L. In the same way, each of the d edges of a 
check node at position I connects uniformly and independently 
to a variable node at position I £ {I — K + 1, ...,/}, so that 
every variable node has one label 1 edge and d — 1 label 
w edges. Note that I is taken modulo L. The variable K is 
called smoothing parameter, and K < L. This approach of 
randomizing connections is based on that of spatially-coupled 
LDPC codes (JJ. Since n(K — 1) check nodes do not have 
information, the dimension ratio Rl of the (a, d, L, K) SC- 
LDLC is as follows: 



Rl = 



n(L - K + 1) 
iiL 



= 1- 



K- 1 



Similar to the (a, d, L) SC-LDLC, Rl converges to 1 as 
increasing L with gap 0(1/ L). Therefore we can neglect this 
dimension loss for sufficient large L. We employ {a, d, L, K) 
SC-LDLC for density evolution analysis in the next section. 

IV. Monte Carlo Density Evolution for 
Single Gaussian Decoder of SC-LDLC 

In this section we describe a method to find noise thresholds 
for (a, d, L, K) SC-LDLC lattices over the unconstrained- 
power AWGN channel. For LDPC codes, the BP threshold 
may be easily evaluated using density evolution which tracks 
the probability density function of log likelihood ratio mes- 
sages exchanged between the variable nodes and the check 
nodes in a bipartite graph |[T2l . However, density evolution 
of LDLC lattices is much more complicated. Since messages 



exchanged in the BP decoder for LDLC lattices are probability 
density functions, density evolution of the BP decoder must 
track the probability density function of the message probabil- 
ity density functions. Due to the space limitations, the LDLC 
lattice BP decoding procedure is omitted; please refer to the 
paper of Sommer et al. J9] for details. 

Here, noise thresholds are found via density evolution, using 
not true BP, but instead a single-Guassian approximation of the 
decoder message lfl3ll . In this approximation, the probability 
density function is approximated using a single-Gaussian mes- 
sage, which is described by just two scalars for each message: 
a mean and a variance. For conventional LDLC lattices, this 
approximate method is effective, giving a noise threshold 
of 0.6 dB |fl~3), the same as the 0.6 dB waterfall region 
of a dimension 10 6 lattice |9). Performing density evolution 
would require a joint distribution in two scalars. While not 
intractable, this is nonetheless computationally demanding. 
Instead, Monte Carlo density evolution will be used, as has 
been done for non-binary low-density parity check codes lfl4l . 
We describe Monte Carlo density evolution for the single- 
Gaussian decoder of the (a, d, L, K) SC-LDLC as follows. 

Variable (check) node at each position I has two message 
pools, V\ and Vw (P[ and Vw ), which distinguish the 
edges labeled 1 from those labeled w. Both V h and V^ 



have N s messages, i.e., 



>(0 



,(0r 



i(0r 



.,(m^[N t ],v^[N a ])} 
■ ,(m®[N B ],v®[N.])}\ 



'n ,; ={W[ww 



for h e {l,ui}. In the following, the index [i] is omitted. The 
pair (m h ',v h ') I (fh h , v h ) J denotes a mean and a variance 
of a variable-to-check (check-to-variable) message transmitted 
from position / along an edge labeled h. 



CO J l h 



,(/) 



1) Initialization: The messages (m h ,v h ) £ V h for all 
I £ {1, . . . , L} and h £ {1, w} is initialized as follows: The 
noise variance a 2 is assigned to y> ' and the received symbol 
/i generated from 7V(0, cr 2 ) is assigned to m h , since the all 
zero codeword, i.e., bi = for all i £ {1, ... , n(L — K + 1)}, 
is assumed. 

At each half iteration, N s messages in V h and V\ t are 
computed alternately for each label h at each position I in the 



following way 
2) I 

le{i 



2) Check node operation: The (ml ,i>i ) G V\j for all 



h ! u /i 

, L} and ft, G {1, w} is computed by 



d-l 



,(') 



£l> 



,('*) 



('.;> 



i('> 



ft 



j'=i 



2-j=i n j v h i 
ft 2 



where lj £ I — w + 1, . . . , I mod L, and ftj € {1, w}. 



d — 1 messages (m h 



(h) Jh) 



) are chosen as follows: 



The 
first 
..,1 



the position lj is uniformly selected from I — w + 1 , 
mod L, then (mi. ,Utf ) is uniformly picked from the V\ 



,(0 .,(')<, 



>(0 



3) Variable node operation: The (m h ,v h ) £ V h for all 
/ G {1, . . . , L} and ft G {l,u>} is computed by 



(m 



(0 (0 



>)=<?(( 






£_f)'Q(- 



O(« , ,< 1 0.0*,o a )) ••■)), 

where (m,v) = Q{[fh h 3 , v h 3 ), (m, u)) is recursively com- 
puted as follows. First (to, w) is initialized by the channel 
output (fi,a 2 ), then 



E c'(6)m'(6), 

E c'(6)(to'(6)) 2 -(E c'(6)m'(6)) 2 , 



6ee 



bee ; 



fcei3, 



where 



Ah) 



m'(b) 



'Ills 

+ —), 



-(h)- 



-Ah) 



c'(b) = ^exp( 



(6/ft,- 



l hi 



cxp( 



2(< j) +^>) 
(6/ft j - m£° 



-). 



2(4' 



ft, = 



^•€{1,.. 
otherwise 



0) 
.,L-A' +1} 



■). 



Similar to the check node operation, the d — 1 mes- 



sages (m h 



-ih) 



) are chosen as follows: first the position 



lj is uniformly selected from I, ... ,1 + w — 1 mod L, then 
(toJj , u}j ) is uniformly picked from the V h . In this 

operation, for each (rn h ,v h ), the (/i, cr 2 ) is also re-sampled 
according to the channel model. 

Note that the order of the recursive computation affects the 
results; the objective here is to minimize the error due to the 
single-Gaussian approximation. The computations are ordered 
using the metric 



M(j) 



i -<,h) 




Fig. 3. Noise threshold, measured in distance from capacity, for various 
(a, d) LDLC. Average variance of messages belonging to nodes labeled w 
for convergence is 10~ li . The number of samples in pool N s is 100000. The 
gap from the capacity is about 0.5 dB. 



We compute (m^ J , u^f ) beginning with the smallest M.(j), 
in order to minimize the single-Gaussian approximation error. 
The above procedure repeats until convergence is detected. 
The mean of the Vw of the message in V l w for all I £ 
{1, . . . , L} was used to check convergence. When the mean 
(over all N s samples at all positions I) fell below 0.001, within 
J max iterations, then convergence was declared. 

V. Experimental Results 

The noise threshold of conventional (a, d) LDLC lattices, 
measured in distance from capacity, is shown in Fig. [3] for 
N s = 10 5 samples. The maximum number of iterations is 
l max = 50. The noise threshold improves for increasing a 
and d. In most cases, increasing a above 0.8 had little or no 
benefit for improving the threshold. Also, the noise threshold 
gradually improves for increasing d, however there appears 
to be marginal benefit for increasing beyond d = 7. Since 
the complexity is proportional to d, increasing d beyond this 
value is not a promising means to improve the threshold. We 
observe that the smallest gap from the capacity is about 0.5 
dB. 

The noise threshold for (0.8, 7, L, 2) SC-LDLC lattices 
proposed in this paper are shown in Table H] with 7 max = 5000 
and 20000, for various values of the coupling number L. We 
observe that the noise threshold of the (0.8, 7, L, 2) SC-LDLC 
lattice, with sufficiently large L and / max , is very close to the 
theoretical limit, within 0.22 dB. Note that the gap of the 
capacity is not a precise value, since the capacity in Eq. (Q~|) 
assumes lattices defined by full-rank matrices, distinct from 
SC-LDLC lattices. The threshold approaches the capacity at 
small L, since the dimension ratio is small (the capacity in (Q]) 
is not valid in this range). However the capacity loss becomes 
small, if L becomes large. For example, the dimension ratio is 
0.998 at L = 500. For a practical system which uses shaping, 
rather than unconstrained power, this is a small penalty. In 
addition, the noise threshold appears to converge at L = 15, 



TABLE I 

Noise threshold (in dB) for various (a = 0.8, d = 7, L, K = 2) 

SC-LDLC LATTICES WITH JV S = 1000. NOTE THAT THE THRESHOLD 

APPROACHES THE CAPACITY AT SMALL L, SINCE THE DIMENSION RATIO 

IS TOO SMALL (THE CAPACITY IN {TJ IS NOT VALID). 



/max = 5000 
/max = 20000 



15 



100 



300 500 



0.00 
0.00 



0.17 
0.17 



0.22 0.22 0.26 0.29 
0.22 0.22 0.22 0.22 



TABLE II 

Noise threshold (in dB) for various (a = 0.8, d, L, K) SC-LDLC 
with / max = 5000 and N s = 1000. Noise threshold does not 

IMPROVE FOR INCREASING d, HOWEVER SLIGHTLY IMPROVES FOR 

increasing K at the same R l . This is because there might be 

SOME WIGGLE JTJ . 
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VI. Conclusion 

This paper has described a new LDLC lattice construction, 
based upon spatial coupling principles. Evaluation was per- 
formed using Monte Carlo density evolution using a single- 
Gaussian approximation of the belief-propagation method. 
While the conventional lattice construction has a gap of 0.5 
dB to capacity, the proposed SC-LDLC construction has a gap 
of 0.22 dB to capacity, of the unconstrained power channel. 

A significant open question remains: how to close up this 
0.22 dB gap to capacity? While spatial coupling improves the 
noise threshold, the ultimate lattice performance can be no 
better than the ML performance of the lattice itself. This opens 
the opportunity for new code designs, for example, by more 
closely considering the edge label values, or allowing for non- 
uniform degree distributions. On the other hand, we must allow 
for the possibility that the single-Gaussian approximation 
introduces errors that limit the threshold under the evaluation 
method used here. 



since the threshold remains 0.22 dB, independently from L, 
for a sufficiently large number of iterations. 

The noise threshold for various {a = Q.8,d,L,K) SC- 
LDLC lattices are shown in Table [n] with I max = 5000. The 
noise threshold does not improve for increasing d, this is the 
same observation as in Fig. [3j however slightly improves for 
increasing K at the same R^. This is because there might be 
some wiggle [I]. There might be a gap from capacity even if 
the wiggle vanishes with large K. 

Fig. H] shows the trajectory of v\J at various node positions 
as the iterations progress. As expected, the variances from 
the variable nodes at the start and end position decrease 
rapidly due to the reliable message from the null check node. 
This phenomenon is the same as the observation in spatially- 
coupled LDPC codes over BEC Q. 
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Fig. 4. (a = 0.8, d = 7, L = 31, K = 2) SC-LDLC, a 2 = 0.0548905: 
Density evolution variance v\J at the positions I =1, 6, 11, 16, 21, 26, and 
31 at the iterations. 
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